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ABSTRACT 

This study, part of an instructional development 
project, ezflcres the effects of three different representations of 
functional algorithms iD an iDticauctory chemistry laboratory. Intact 
classes were randomly assigned to a flowchart, list, or standard 
prose representaticn of the procedures (algorithms) . At the 
completion of 11 laboratory sesslcns* data vere collected od critical 
tliiDkiDg ability as measured by the WatsoD-Glasei: Critical Thinking 
Appraisal. Laboratory instructors' estimates of completion time for 
each lab were obtained. Analysis indicates that mode of 
representaticn produces no significant difference between groups on 
critical thiDkiDg ability. However, a differential effect i^n 
laboratory ccmpletion times was found. Appended is a sample of each 
type of functional algorithm employed. (STS) 
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ABSTRACT 



As developers we often find ourselves shifting from one role 
to another throughout the.jscope of a proj^ect. At first, constraine 
by real worlu 1 imitations" we ieek strategies that improve precision 
in our work. Later, we ma"y wonder why certain strategies" are more 
effective and explore these questions. It is not a matter of which 
is better — prediction or understanding — for these are separate 

^ ^^nv^A^ \t This paper 



better — prediction or understanding — for these are sepa 
and distinct issues and should be judged accordingly^ This pa 
primarily addresses the praxiological question, a question of 
alternatives (which?) rather than the theoretical or scientific 
question (why?) , Yet, in a serendipitous way those questions of 
alternatives may lead to statements of understanding. We often hope 
they do, but we will not have failed if they do not. 

This study explored the effects of three different represen- 
tations of functional algorithms in an introductory chemistry ^ 
laboratory. Intact classes were randomly assigned to a flowchart, 
list, or standard prose representation of the procedures 
(algorithms). At the completion of 11 laboratory sessions data were 
collected on critical thinking ability as measured by the Watson- 
Glaser Critical Thinking Appraisal. Additionally, laboratory 
instructors* estimates of completion time for. each lab were obtained. 
Analysis indicates that mode of representation produces no signifi- 
cant difference between groups on critical thinking ability. However 
a differential effect in laboratory completion times was found. 
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INQUIRY It^ DEVELOPMENT: 

Efficiency and ef fdcti veneis^ of algorithmic representations 

in a laboratory situation 

William C. Coscarelli 

BACKGROUND OF THE DEVELOPMENT PROJECT 

In the fall of 1974, a single and s/eparate two-credit chemistry 
laboratory course was created dt Indiana University for students 
staking one of twQ possible lecture cojorse^, Chemistry 100 or 

Chemistry lOT. Chemistry 100 is a p/e-s^^mester terminal course 

/ / 

designed primarily for students maj/oring in liberal arts, business, 
or education. In the first third/of ^he course, basic topics such 
as atomic theory^ bonding, and thre^^dimensional molecular struc- 
ture are discussed. The middle/third deal5; with\large molecules 

/ \ 

and biological chemistry. The^'final third examines topics of con- 
temporary in teres t incl uding /drugs > food addi tives , pol 1 u tion , etc . 
Little, if any mathematics /s/ used in this course. Chemistry 101, 
is the first semester of a/tjf/o-semesteY sequence designed for non- 

sciencfe majors and those ^/in /various allied health fields who do 

f I 

not need more than two s,4me$ters of chemistry. In this course, 
the basics of atomic theorj/^ uonding structure, etr., are studied 

in more detail. Addi 1^'^ ona^i ly , moTe calculations, the gas laws* 

{ ! 

chemical equi 1 ibrium j';^hemi cal reactivity, oxidation- reduction, 
isomerism, and i ntrt^tl^ctqVy organic chemistry are presented. 
There is no chemistfy pr/erequ I si t e for ClOO, ClOl, or the labora- 
tory course. Desp^Ue ^'he differences in the needs and backgrounds 
of students enrolled in ClOO and C101» a laboratory course had to 
be designed whic^i would serve both groups. These differences in 
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course content and emphasis do quite clearly produce student? having 
dlfVerent backgrounds of chemical knowledge. Since no one back- 
ground can be assumed, the laboratory course has to provide any 
information necessary for the successful completion ^of an experi- 
ment. During the falT semester of 1974* the course was presented 
iTi^a rather traditional format and the problems with this approach 
became evident* In the Spring semester of 1975, a concerted effort 
was made to develop the course with-,the assistance of the Division 

; f ' 

of. Development and Special Projects at Indiana University. 

FINAL PRODUCT OF THE PROJECT ^ ■ ^ - 

a . Components . 

From the results of a student qyestiornia i-re and a' knowledge 
of the level of performance which the students had achieved (as 
assessed from the results of various exams conducted throughout 
the semester), a basic instructional format was designed and 
applied to each of the experiments and study exercises used 
throughout the course. Each laboratory experiment or exercise 
was preserjted in a Learning Activity" Package (LAP) form* These 
packages contain seven components and range in length from 13 to 
41, si ngl e-spaced typewritten pages. The sections are described 
as follows: (1) Introdtfction : Each experiment is introduced by 
describing the nature of the problem to b<j investigated. 
(2) Objectives : A detailed list of objectives is provided and 
divided into three sections: (a) Entry behaviors {those tasks 
which the students are expected to be able to perform before they 
begin the experiment), (b) procedures (those tas*ks which pertain 
to procedural aspects), and (c) instruction and results (those 
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, tasks which deal with background material, calculations, inter- 
pretation of .results, etc.). (3) Instruction : A discussion of 
the principles, calculations, etc., which ar? involved with the 
experiment is provided. Often, more than one type of instructional 
approach, such^, as prose, programmed instruction, practice problems 
In the text,, i^ used in this\ section. The physical length and com- 
plexity of this material varies from one experiment to another. 
(4) Procedures: A detailed discussion of the nature of th& pro- 
cedures section is provided below. (5) Data and Report Sheiets : 
^These are sections ^in which data are recorded, results are calcu- 

lated, and interpretations and conclusions are laade. (6) Advan ced 

\ ^ ' 

Study Assignments : Exercises are specially designed to prepare 

students for the experiment by covering background material as 

well as experimental methods whenever necessary. Completion' of 

the Advanced Study Assignment ensures that the student will be 

familiar with the experiment. Consequently, the student will not 

have to spend any laboratory time getting organized. (7) Practice ^ 

Post Test : This consists of a series of questions designed to 

allow the student to evaluate his progress in learning and applying 

the principles in the experiment. Answers are provided, the 

material in the instructioi* section and the questions in the 

advanced study assignment and practice post test are keyed by 

number to the objectives. 

b> Measurement of Student' Performance 

Evaluation of student performance is made irj several ways 

during the course of the semester. (1) A pretest over various 

arithmetic skills is given at the beginning of the semester. 

6 



From the results of this test, students are advised to complete 
various remedial exercises. (2) Advanced study assignments and 
reports are graded weekJ-y^ Students c.an follow their proijress 
and determine their areas of weakness. (3) Practice post tests 
included with the lab material are used by the student himself 
for his own evaluation. They provide immediate feedback* 
(4) Four examinations are given during the course* The first is 
a short exam whose. purpose is tc acquaint students with the type 
of test items and to show them how exam questions cover the objec- 
tives. The other three are full-length exams which include questions 
at the knowledge level, questions which require application of 
principles, and questions which require analysis of information or 
synthesis of ideas. Laboratory work constitutes 70 percent of the 
student's grade, while exams total 30 : ercent. 
c. Al gori thmiza t i on of Procedures 

The general package as described above, seemed quite capable 
Of dealing with many of the problems which the students faced. It 
did not, however, address the problem of ^iltudent a/ixiety and lack 
of confidence* The students are limited to two hours per labora- 
tory session. In order to collect the quantity of information 
required to ma_ke^observa t i ons , to perform calculations, and to 
reach conclusions in an experiment, the student must complete his 
procedure and he must believe that his Infonriation is correct and 
complete. Students enrolled in this course generally lack experience 
in a laboratory and experimental situation* They are also unfamiliar 
with the practice of organizing themselves so that tasks can be 
completed in a reasonable peridd of time* These factors combine 



to cause unce^^tainty, anxioty, and a certain number of errors. 
In order to alleviate these problems and to insure early success 
and self-confidence, the procedures or algorithms were presented 
in a flowchart form. These flowcharts served various pu**poses: 
(1) To simplify otherwise complicated procedures; (2) To m^ike pro- 
cedures more organized and efficient, especially when several steps 
tn one section cf a procedure are repeated over and over; (3) To 
reduce procedures to a series of short steps, so that attention is 
focused on one aspect at a time; (4) To ask questions, and require 
that decisions be lAade at any appropriate timers during the pro- 
cedure. An example of a flowchart appears in Appendix I. *This 
• algorithm was designed for a portion of a qualitative analysis 
experiment in which a mixture is being tested for chloride and 
iodide ions. Since these ions interfere with each other, a 
separation procedure is required, making the analysis relatively 
compl icated . 

A FRAMEWORK FOR THE PROBLEM 
a . Def i ni tions 

Each laboratory procedure the student performs is a sequence 
of operations that lea.ds to the solution of a problem, in short, 

an algorithm^ In addition, these operations or algorithms 

■ ^ 

Handa defined the algorithm as a "pjhecise, generally comprehen- 
sible prescription for carrying out a defined sequence of elementary 
operations in order to solve any problem belonging to a certain 
class." The algorithm has three characteristics: 

1) Specif ici ty--di rect instructions that preclude chante 
components in the choice of actions, 

2) General ity--any member belonging to the defined class 
can . be substituted . 

3) Resultivity---the same result is always produced in the 
presence of the appropriate data set. 

Others (Brecke, 1 975; Merrill, 1975; Serl ach , ejt jlL> 1975) have 
adopted similar definitions. Q 



maintain different levels of control with respect to a given task. ' - 

Viewed from the point of intended goals there are two types 
of algorithms: algorithms cf transformation and algorithms of 

identification. The algorithm of identification produces a judg- " 

\ 

ment of the initial objeuts' belonging to a certain class, e.g.], 

■ \ 

identifying the ions 1n a solution. The algorithm of transformation 
produces a change of state in the initial object, e.g., combinirig 
hydrogen and oxygen to form water. 

Viewed from the point of control there are also* two types of 
algorithms. A functional algorithm exists when no other control 
of the system is necessary by additional systems. A controlling! 
algorithm exists to provide a functional algorithm with a set of ■ 
pro^cedures for coping with unspecified {by the functioning algorithm) 
circumstances, e.g., if a student is using a functional algorithm 
to identify the ions in a solution and notes a reaction occurring 
that is not in the procedures, he can turn to another set of pro- 
cedures or his teacher to provide the p^rocedures for coping with - 
this unexpected^ circumstance. The procedure he turns to, either 
in another book or through the teacher, is the controlling algo- 
rithm. It should be noted that the concepts of "functional** and 
*'contron ing** algorithms are relative. A system that controls 
a functional algorithm may be functional itself, requiring assis- 
tance from another algorithm in the event of a circumstance 
occurring that it is not equipped to handle. 

Table 1 illustrates the relationship between the goal of 
the algorithm and the level of control exercised by the 
al gori thm . 9 



Level of Control 
Functional Controlling 

Identification 

Goal 

Transformation 



Table 1 

Given that we have determined that a problem a student is 
facing can be solve^ via an algorithm we can develop appr^baches 
to teaching these algorithms. Whether we wish to teach an 
algorithm of addition, ion identification, or sentence classifi- 
cation, we can choose from five basic techniques (as outlined by 
Landa): 

(1) Teach the algorithm of solution--We can provide the 
student with the algorithm to solve the problem. This 
would entail description of steps and decision points with 
alternative courses of action outlined. 

(2) Teach ;a search algorithm to identify other algorithms-- 
All possible operations and their sequences are given to 
the student without explaining the algorithm of solution, 
e.g., try switch 'a' arid 'b'; if 'x' happens then do 'y.' 
If not, try '2,* etc. In carrying out these operations 
the algorithm of solution is discovered. 

(3) Teach general methods of searching which are non- 
algorithmic in nature--The algorfthm is neither explained 
or provided, "he student is given instructions that 
could lead to the discovery of the algorithm, e.g., "try 

10 
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different sequences," 'identify the parts." This approach 
ieaves open the possibility of not discovering the algorithm. 

(4) Teech separate rules of dction--Teach the rules that 
apply to the situation, without any specific ord^r, e.g*^, 
"turn knob A," "move bishop on the diagonal." 

(5) Don't explain the algorithm or rules--This implies a 
structured environment to allow the student a chance to 

. carry out search trials. 

These five categories identify the possible alternatives 
available to the instructional developer in specifying instruc- 
tional strategies utilizing an algorithmic approach. One suspects 
that certain strategies are more effective and/or efficient under 
certain conditions, e. g . , si tuati ons placing a premium on time to 
completioii and low error rate for a task would most likely require 
the teaching of an algorithm of solution. 

For the developer, acting as inquirer, these categories 
represent the nucleus of a concentrated research effort in iden- 
tifying optimum strategies for tasks given real world constraints, 
e.g., "low error rate," "learn search strategies." Indeed, the 
rocus of the present study is to examine some of the effects of 
presenting an algorithm of solution to the learner. 

Because we were dealing with a relatively naive population 
(at least in chemistry knowledge) with a high anxiety level and 
because we did not have a large amount of time available for 
each lab we placed a premium on a strategy that would reduce 
error rates and increase efficiency. Additionally, we decided 
that until the students were more sophisticated we should provide 

11 



them with the algorithm of solution for each problem rather than 

attempt to have them derive the appropriate algorithm, (In our 

laboratory situation we were presenting functional algorithms of 

identification and transformation,) „ 

Initially we chose to use flowcharts to represent the 

algorithms. As Lewis et. aj[ (1), note; 

"Flowcharts have compelling advantages over their prose 
counterparts. From the user's point of view,, they 
simplify the reasoning process in several ways. Instead 
of leaving him to find his own way through a mass of 
tiresome prose, they^present him with a minimum sequence 
of simple (yes/no) questions. Moreover^ each question 
is unambiguous and relevant, There is never any need 
for the user to wonder if, the sentence {or question) he 
is reading is relevant to his own case. And ther^? Is 
never any need for him to wonder what he should consider 
next, because each answer automatically routes him to 
the next relevant question," 

Finally, Lewis, et al^ (2), have demonstrated the advantage of 

flowcharts in decreasing task -cpmpletion time and decreasing 

error rates, 

b. Alternative Represejitations 

Just as there are more ways than one to skin a cat, there 
J^re more ways than one to represent an algorithm. Each represen- 
tatlon can vary in terms of readibility, structural clarity, 
effort required to pi^oduce copy, and space required for printing (3), 

classically, standard prose has been the method of representing 
an algorithm in the laboratory situation. However, written , instruc- 
tions are often presented in ways that are difficult to understand 
{3, 4, 5), Prose instructions require the reader to procesr; all 
information regardless of relevance to the task. This alone could 
lead to confusion and an improper solution to the task; especially 
when the task itself is fairly complex. Furthermore, this complexity 

12 
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can be compounded through the grammatical structure of the prose. 
As a result prose should probably be restricted to situations in 
which procedures or instructions are short, have a minimum of inter- 
actions and qualifications, and can be presented in positive, active^ 
and affirmative' sentences (6). 

Another alternative representation for an algorithm is the 
list form- This representation is closely related to the flowchart 
form. The list form replaces the graphic characteristic of the. 
flowchart with prose. Discrete decision points with alternative 
tasks are identified through reference to numbered statements, 
.So too, the reader has only to read what is relevant to his specific 
task rather than the sum total of information that would need to be 
read in a prose situation- . ^ \ 

Other types of representations: Coded graphics, decision 
tables, and linear listing (7) have th°ir own unique characteristics 
but are not particularly appropriate for use in this laboratory 
^situation. Coded graphs and linear lists would probably require 
more skill to use than other representations and could become an 
obstacle to the student rather than a help. Decision tables are 
more properly used in situations requiring identification of parti- 
cular conditions--they cannbt represent the appropriate sequence of 
tasks which must be performed over a period of time as is the case 
with laboratory procedures. 

As a result of these considerations one could conclude that 
procedural algorithms in the laboratory could best be represented 
in prose, flowchart, or list form. Appendix I contains an example 
of each of these representations. 

13 
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c. Possible Cosequences 

Because each representation has its own unique characteristics 
one might suspect that use of a given representation would have 
specific consequences on the manner in which a problem is^ resolved 
Research to date in the use of algorithmic representations has 
g&nerally been limited to an examination of the efficiency of the 
algorithm in completing a procedural task as well as decreasing ^ 
error rates (8), Only recently^.has an attempt been made to assess 
higher order effects of tHeSe "ready-made algorithmic prescriptions. 

Coscarelli, Visscher, and Schwen (9) discovered that critical 
thinking ability was developed by presenting an algorithm to -^he 
student in a flowchart repre;5entati-on. While there exists fio 
generally accepted explanation for this phenomenon it is possible 
that the mode of representation {in this case^a flowchart ) provi des 
the learner with a generalized model with which to approach prob- 
lem solving. Carpenter in Solomon (ID) observed that media are 
not simply envelopes into which letters of various kinds can be 
slipped. The medium itself may be a message with a code and grammar 
of its own."^ Soloman has also suggested t^hat media can affect cog- 
nition much as language can structure thought. Consequently, the 
manner of representation could have a serendipitous sl^e-effect^ 
that of increasing overal 1 probl em solving skills* \^ \ 

PURPOSE DF THE STUDY 

The purpose of the present study will be to explore, in a 
chemistry laboratory situation, the effect of different represen- 
tations of functional algorithms on critical thinking ability and 
laboratory efficiency- 14 
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a. Statement ot^the Problem 

As we^tiave seen eav'lier, e^ch repre^sentation of an algorithm 
has its owii: parti cul ar charactefr.'^ s^:ics . Furthermore, there seenis 
to be som^ evidencevthat thes^eTrepresentations can affect the 



efficiency/w4Jh whichNa^ task tfS. cgiiipjlefed as well modify cog- . 
nitive skills. , As a reSaJtr w^ are posing two researcliable questions 
in relatl^pji'Hio thg^use of flo>ichart, list form, and prose represen- 
tations of an algorithmic process, 
b_; Researchablg^ Questions 

(1) Will the type of representation affect the time 
necessary to coifiplete a\procedurje.2^— 

(2) Will the type of representation' affect critical 
thinking ability as mea^ure^d on a standardized 
test of critical thinking? 

C- Independent Variables ^ 

The independent variable will be the manner of representation 
of the algorithms. The variable will have three values* these 
are based on a systematic variation of three rules for represen- 
tation, i.e,, each statement in the algorithm provides information 
critical to performing each step in the procedure, statements (nay 
^^contain one or more than one task, decision points may be repre- 
sented via flowchart symbols, referral to numbered statements, 
or standard prose . 

As an algorithm defines each step of a procedure and accounts 
for anyvpossible occurrence, e.g,, .*Mf a precipitate occurs, add 
2 mK of NaN03; if no precipitate occurs, centrifuge the solution;'' 
the representations will vary the characteristics of the fancier in 

15 
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which each step is presented to the student. Each step in the 
representations will contain only information necessary for the 
completion of one task* e.g.* "add 1 ml. of to the testtube," 
For the flowchart and list form representation each statement will 
contain only one task. (A statement is defined ^s the basic unit 
of representation. For the flowchart this will be the area In a 
box* for the rule-set a^numbered , command* and for the standard 
prose representation this will be a sentence.) The. standard prose 
representation will often have more than one task in a unit* e.g.* 
"After you have added 1 ml . of H2O to the testtube, stir-and 
filter the solution," 

The three values of the independent variable are ;FLOWCHART 
REPRESENTATION {Group I) ^ 

(1) Each statement contains only one task. 

(2) At decision points alternatives are indicated 
graphically in accordance with lOS Standard 102**-- 
"Information Processing-Flowchart Symbols," 

LIST FORM REPRESENTATION {Group II) 

(1) Each statement contains only one task. 

{2) At decision poi nts al ternati ves are indicated 
through referral to numbered statements , 
{NB; It is the difference between Groups I and II that Is of major 
interest. These groups vary only one way--the representation of 
the decision points and tiie alternatives.) 
STANDARD LABORATORY REPRESENTATION {Group III) 

{1) Each statement may contain more than one task. 

(2) At decision points alternatives are indicated 
through unnumbered statements. 

16 
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Table 2 sammarizes .the variations between groups. 



GROUP 

RULE 


I II III 


1 . CRITICAL TO TASK 

2. ONLY ONE TASK 

3. FLOWCHART 
REPRESENTATION 


X' X X 
X X 0 

X 0 0 



TABU 2 



d. Dependent Variables 

There are two dependent, variables in the present study: 
score on the Wa tson-Glaser Critical Thinking Appraisal (W-6) 
and time spent in performing the laboratory exercise: 

The degree of skill in c|;itical thinking ability will be 
defined in terms of the score on the H-^G, Watson and Glaser (1964) 
concluded that critical thirvking can be viewed as a "composite of 
a tti tudes , knowledge , and skills,** This compos i te incl udes : 

(1) Attitudes of inquiry that involve an ability torecognize the" 
existence of problems and an acceptance of the general need for 
evidence in support of what is asserted to be true, 

(2) Knowledge of the nature of valid inferences, abstractions, 
and generalizations in which the weight or accuracy of different 
kinds of evidence are logically determined, 

(3) Skills in employing and applying the above attitudes and 
knowledge. More spec^ifically, a person with a high degree of 
critical thinking skills would be able to do the following:, 

17 
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(1) Define a problem. / 

(2) Select pertinent i nf ot/mati on for the solution 
of a probl em. . 

(3) Recognize stated and unstated assumptions. 

(4) Formulate and select relevant and promising 
hypotheses. 

\(5),Draw valid conclusions and judge the vali^lUy 
\ of inferences. (Dressel and Mayhew» 1954), 
Independent studies (H6ule» 1943; Morse aod McCune» 1957; Hovland, 
1959; Ril^st, 1960, 1962) have verfie^d.the construct validity^of the 
W-G as a\measure of critical 'thiniiing. Watson and Glaser (1964) 
report a'^plit-half reliability coefficient corrected by the 
Spearman-Brown formula of ^85 for liberal arts freshme^n. . ' 

The time spent in perform^ing thq laboratory exercise was 
measured by the two lab i^^st^uctors in each la^. ^hey ^ere asked 
to estimate the average time spent by the students in completing 
each lab exerblse. 

e. Design , 

The present study is a pretest-posttest design- Table 3 
illustrates this design. 
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0 ' . 
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0 


^^3 


0 



TABLE 3 
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f > Instrumenta ti on 

independent variables 

For each of the values of the Independent variable three 
representation schemes were devised 1n accordance with the rules 
specified for each value* Appendix I lists an example of flow- 
chart, rule-set, and standard laboratory representations • 

2. ' dependent .variables 

The measure for critical thinking skill was a single score 

'i 

on the. The measure for time spent In performing the lab 

exercise was a'primarily subjective estimate made by the 
laboratory instructors. 

g. Sample - ( . ■ 

Approximately 190 students in an introductory laboratory 
chemistry course at Indiana Dniversity-Bloomlngton served as 
respondents in the experiment. Ten injtact classes were randomly 
assigned to one of the three .treatment groups. This produced, a. . 
nested design wfth classes nested under treatment* Four classes 
totaling 82 students used the flowchart representation, 3 classes 
totaling 56 students used the list-form, and 3 classes totaling 
52 students received the standard prose representation. 

h. Procedures 

Previous to the first laboratory session students were 
Instructed to pyrcfhase a particular color coded lab manual. The 
use of this codrng procedure allowed the experimenter to assure 
that there was no intermixing of representations in a given 
laboratory session/ 

All students were given the W-G during the first week of 
classes before Instruction had begun. At the end of 11 lab 
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sessions the^ W-G was administered. Alternate forms of the W-G 
were randomly assigned to treatment -groups in'the pretest situation 
and then reversed for posttesting. It was felt that this would 
help control for practice effects that might occur if the same 
forms were used for both administrations.. Additionally, both forms 
were used on the pretest to help assess differences attributable 
to each form. (It was found that the scores differed in accordance^ 
with published standards and were properly equated in all analyses.) 
In addition, estimates of completion time were collected from the 
lal3t instructors, ^ . ' ^ ^ 

RESULTS ' . . 

As was noted earlier the selection and assignment of intaxt 
. classes prod?iced a nested design. Ideally one -would b^egin the 
analysis using an analysis of covariance (AHCOVA) with a nested 
design. However, due to time limitations and the general lack of 
an acceptable computer program, the SPSS ANCOVA program, which does 
not provide for a nested design, was run to determine the effects 
of mode of representation on critical thinking ability. (It should 
be noted that a series of one-way analyses of variance were per- 
formed to determine that all treatment groups were not significantly 
different on the pretest,} The ANCOVA^ procedure was selected to 
provide additipnial precision in estimating the effect of the 
treatments by controlling for critical thinking ability as assessed 
by the pretest.^ 



^The .correlation between pre and post cri ti ca 1 thi nKi ng scores 
was approximately ,48, 
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a. Effect of Representation on Critical Thinking A b ility 

The results of the ANCOVA procedure are reported in table 4, 



SOURCE 


SUM OF 
SqUARES 




MEAN 
SQUARE 


F 


SIGNIFICANCE 
OF F 


COVARIATE ■ 
PRETEST 


4402,674 


1 


4402,674 


58.323 


,0Q1 


MAIN EFFECTS 

REPRESENTATIONS 


25,929 


2- 


12,964 


,172 


,842 


EXPLAINEO 


4403,982 


' - 3 


1467,994 


19,447 


,001 


RESIOUAL 


14040,734 


186 


75,488 






TOTAL ' 


:8444,715 


189 


97,591 







" TABLE 4 

b. Effect of. Representation on Cortn>letion Time 

The results of the various representations on completion time 
are found in Figure K 



INSERT FIGURE 1 A80UT HERE 

The X-axis represents the average completion time for each lab 
session as reported by thje lab instructors* Each'^mark along this 
axis represents an individual laboratory session. The Y-axis 
represents deviations from the average Jaboratory completion time, 
A positive score indicates that the time of completion* was greater 
than average; a negative score indicates completion* tim^ was less 
than average. The units along this axis represent minutes* 
c. Effect on Grade for Qualitative Analysis Lab 

Because the^*e appears to be a highly differential effect 
between representations during the third and fourth labs an analysi 
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FIGURE 1 



Average Conlpletion Time per Treatment 




19 

of variance was added to assess the effect of mode of representation 
on the grade for these labs. Table 5 reports the results of this 
analysis. ANCffVA procedures were not deemed necessary (though 
could b^ added later) due to the low correlation between pretest 
score and grade on these labs (.14). 

SUM OF MEAN 
SOURCE 6f SQUARES SQUARES F F Prob, 

BETWEEN GROUPS 2 317.4583 158.7292 1 .808 .'l67 
WITHIN GROUPS 180 15806,789 87.8'165 
TOTAL ' 182 16124,4372 

- ' < 

TABLE 5' 

DISCUSSION 

f 

The present results suggest that there may 'be no connection 
between mode ^fO^epresentati on and critical thinking ability. If 
this is the case one might question the hypothesis of Solomon that 
media can influence cognition much as language structure$^tfj4ught. 
However, one might also conjecture tKat the strength of the treat- 
ment was insufficient to cause a change in overall problem solving 
skills. To be sure* the effects of any of the representation.s 
could be mediated by the availability of lab instructors and fellow 
students who could provide additional guidance (controlling algo- 
rithms) in difficult situations. This would diminish the effect of 
the representation in structuring new thought processes. 

In an earlier study (Coscarelli, et^ai), critical thi'nking--as 
defined by another measure, was enhanced by a flowchart representation. 

^ ' 24 



20 



If the transfer effect found in that situation existed; the 
question raised now is: Did the dependent variable in that study 
measure critical thinking? If not, what did it measure? These 
questions are worth further exploration. 

For the time being, the theoretical question must remain 
unanswered; but the praxiological one of serendipitous side effects 
may be one step closer to resolution. In a rea^-world laboratory 
situation there may not be much hope of generating critical thinking 
via representation mode. 

In the area of efficiency we found an interesting effect among 
representation modes. Generally speaking, the flowchart group 
performed poorly compared to other representations on the initial 
labs, moved on to demonstrate efficiency and then tapered off.. 
For the prose group the resylt was the reverse before tapering. 
^^J+ie list-form group proved the most stable across all labs. 

One might hypothesize that these results can best be explained 
as a function of familiarity and algorithmic difficulty. For the 
.students using the flowchart representations, an initial period 
of adjustment to. an unfamiliar mode of represejitation was necessary. 
Those using representations more nearly parallel to standard prose 
faund initial adjustment quite elementary. However, upon encountering 
the qualitative experiments, perhaps the most difficult of the labs , 
the flowchart provided a definite advantage to the student in 
clarifying a complex series of instructions. Additionally, an 
analysis of the score for these labs indicates there exists no 
significant difference between gf'oups. In this instance, one 
could argue that the use of flowcharting provides an efficient 
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a n d effective method of representing a functional algorithm of 
identification. 

Interestingly enough the Hst-form remained most constant 
across. labs in approaching the average time of completion. Later, 
in a final laboratory experiment where students were required to 
develop their own set of proc.edures fot" a lab exercise; students 
would tend to 11st the procedures In the manner In which they had 
received instruction, i.e,» flowcharts used In the flowchart group, 
etc. However, If the procedures were not detailed 1n the mode of 
instruction they were alrnost always presented Iti a list-form. "^ This 
despite a lack of interaction with the 1 i s t-f o^m representa ti on» 
may indicate a generalized mode of thinking among students in 
approaching a complex prc^edurfi. Again, it remains a question 
open to further exploration* 

Finally, the tapering effect found after the first four lebs 
may be due to the students' ability to deal with the environment, 
not as the naive respondents they were upon entering the course, 
but as rel a ti vely sophisticated chemists. As they became more 
assured and kriowledgeable It would be possible for them to move 
from 'the crutch of a specific representation mode and attend to 
the complexities of the individual task; transcending the repre- 
sentation scheme. 

CONCLUSION 

We have seen that the mope of representation for algorithmic 
situations^ may not provide y! Increase in a generalized skill such 
as critical thinking but tfjat it may have an advantageous effect 
on more specific maJTsures o\ efficiency and effectiveness (as 
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measured by tasks closely . related to the use of the procedure) in 
complex situations. What we may have seen is that the mode of 
representation can be a useful tool or hindrance depending on the 
complexity of the task and as with so many other things task. com- 
plexity is a relative matter, i.e., lab procedures initially found 
difficult may be difficult to factors beyond the scope of the 
algorithm involved such as situation familiarity, confidence, etc. 
For these situations a flowchart or list-form may prove most use- 
ful. ^ In other situations^where complexity is not an issue* repre- 
sentations are equalized ^nd might best be selected using an 
affective criteria of student preference* 
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ERIC 



QUALITATIVE ANALYSIS: FLOWCHART REPRESENTATION 
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START I 
— in— ' 



Select two test tube) 



To fitst tutse # 1. Mkt 
1 ml of a 50-50 
mbctufe of 0.1 M KaO 
and ai M NtL 
To last ti*e #2. add 
1 ml of unttnown sdn 

■ I 



Add 1 ml 6 M 
PPT and stir 



NH3 to 




Add 1^-2 ml 6 M 
HNQs to dear iquid' 



Add 1 ml of 6 M HNO, 
and 1 ml cf0.1 M 
AgNCt] to esdi 




Add 1 ml 6 M HNO, 




Add a taw nKX« drops 
of ai M AgNO^ to 
supemstB 




)Ho 
I Cvitrifuge | 

I SAVE PBEaFTTATE 



cr and [ absent 
Ga to other atvon tests 



'3 1 


YfiS 


SAVE SUPERfWTE 






Add 2 ml 6 K 
HHO^ to supefnate 

■ - 




cr and r absent 
Oo other anion tests 



cr present 
r Absent 



c STOP :) 




Perfon m Special Tes t tor f 
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QUALITATIVE ANALYSIS: LIST-FORM REPRESENTATION 



1. Select two test tubes. 

2. Add 1 ml of a 50-50 misturfe of 0^.1 M NaCl and 0.1 M Nal to test-tube HI. 

3. Add 1 ml of the unlcnown ^to test tube ^2. 

4. ^ Add 1 ml of 6 M fiNO^ to each test tube. 

5. Add 1-ml of 0.1 flJ^AgNOj to each test tube. 

6. If a precipitate^ occurs , go to statement *f9^j 

7. If no precipitate occurs, go to statement ^8. 

8. CI- and I are absent. Go tl) statement iS39. 
. 9. 1 ml 6 M HNO3. 1 

10. if the precipitate remains, go to statement iS12. 

11. If no precipitate remaihs, go to statement ff8. 

12. Centrifuge the solution. 

15. Add a few drops of 0.1 M A^NOj to supemate. > ^ 

14. If a precipitate occurs; g8 to statement ffl2. 

15. If no precipitate occurs, go to statement ffl6^ 

16. Centrifuge the solution. 

17. Save the precipitate. 

18. Ada 1 ml 6 M NH3 to precipitate. '' 

19. Stir solution. 

20. If the precipitate remains, go to statement ff22. 

21. If no precipitate , remains , go to statement ff27. 

22. Centrifuge the solution. 

23. Save the supemate. 

24. Add 1 1/2-2 ml 6 M HNO3 to supemate. 

25. If a white precipitate occurs, go to statement 30 . 

26. If no white precipitate occurs, go to statement S33. 

27. Add' 1 1/2-2 ml of 6 M HNO3 to clear liquid. 

28. If a white precipitate occurs, go to statement S35. 

29. If no white precipitate occurs ^ go to statement ff37. 

30. CI" V -^sent. 

31.. Perform special test of I-. " . 

32. Go to statement Sf38. 

33. V ci- present. 

34. Go to statement iS31.^ 

35. CI- present, and I- present. 
36* Go to statement ^38. 

37. Cl-^ absent and I- absent. 

38 . STOP 

39. Proceed to other anion tests 
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QUALITATIVE ANALYSIS: STANDARD PROSE REPRESENTATION 



Select 2 test tubes adding 1 ml of a SO-SO misture of 0.! 
M NaCl and o.l M Nal to the first test tube and 1 ^ml of the 
unknown to the second. Then add 1 ml 6 M HNO3 and 1 ml of 0.1 
M AgNOj to each test tube. If no precipitate"occXirs\you have 
determined that CI- and I are absent and you should proceed to 
the ather anion tests. If a precipitate occurs add 1 ml of 
6 M HNO3. If the precipitate disappears; CI- and I are absent 
and you should proceed to the other anion tests. If the 
precipitate remains, centrifuge the solution and add a few 
arops of 0.1 M AgNOs to the supemate. If a precipitate occurs 
centrifuge the solution again and add a few more drops of the 
0.1 M AgNOj. Continue t^o do this until no precipitate occurs. 
At this point, centrifuge the solution and save the precipitate. 

Add 1 ml of 6 M NHj to 'the precipitate and stir. If 'no 
precipitate remains add 1 1/2-2 ml 6 M HNO3 to the clear liquid 
If a white precipitate occurs CI- is present and I is absent. 
If a white precipitate does not occur, CI* and I are absent. 
If, afteT adding the 6 M NH3 a precipita:te does remain, 
centrifuge the solution and save the supemate. Add 1 1/2-2 ml 
of 6 M HNO, to the supemate. If no white precipitate forms 
CI- is absent. If 'a white precipitate forms, CI- is present. 
In either case, it is necessary to perform the special test for 
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A FINAL NOTE 



Because of the nature of this study I must also 
acknowledge tie contributions of. Marty Visscher who was 
my client in the development of this course and Tom Schwen 
who served as consultant and teacher throughout the pro- 
ject. The chemistry {excuse the pun) of the team led tp 
a synergistic whole that will not be duplicated for some- 
time to come. 
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